CERTIFICATE 



I, the undersigned, Takashi KISO, residing at 5th Floor, Shintoshicenter Bldg., 24-1, 
Tsurumaki 1-chome, Tama-shi, Tokyo 206-0034 Japan, hereby certify that to the best of my 
knowledge and belief the following is a true translation into English made by me of Japanese 
Patent Application No. JP 11-213808 filed on July 28, 1999. 

RECEIVED 

JAN 1 3 2004 

Technology Center 2600 

Dated this 19 th day of December, 2003 



Takashi KISO 



Reference Number = 2905415003 



Application Number HEI 11-213808 



[Name of Document] 
[Reference Number] 
[Filing Date] 
[To] 

[International Patent Classification] 
[Inventor] 

[Address or Residence] 



[Name] 
-{ Applicant for Patent] 

[Identification Number] 

[Name] 
[Agent] 

[Identification Number] 

[Patent Attorney] 

[Name] 
[Indication of Official Fee] 

[Prepayment Register Number] 

[Amount of Payment] 
[List of Items Submitted] 

[Name of Item] 

[Name of Item] 
) [Name of Item] 
[Number of General Power of Attorney] 



PATENT APPLICATION 

2905415003 

July 28, 1999 

Cornmissioner, Patent Office 
H04N 7/32 

4-3-1, Tsunashimahigashi, Kohoku-ku, 
Yokohama-shi, Kanagawa 
Matsushita Communication Industrial Co., Ltd. 
Koji IMURA 

000005821 

MATSUSHITA ELECTRIC INDUSTRIAL CO., LTD. 

100105050 

Kimihito WASHEDA 

041243 
¥21,000 

Specification 1 

Drawing 1 

Abstract 1 
9700376 



[NAME OF DOCUMENT] 
[FIG. ID 



DRAWINGS 




CO 

o 



o 



O 
O CO o 



< CO O 

QC — 



opo 

3 Q_ I— 
< LU O 
CCOlU 
LU CO 

tr 



MODULATION/ 
DEMODULATION 
SECTION 



CO 

o 



O 

cr 



BE 



O 



~ o 
go 



o 



< 
cr 






IMAGING 
SECTION 


CO 


DISPLAY 
SECTION 







JAN 0 9 2BN 



[FIG. 2] 



V 




[FIG. 3] 



JAN 0 9 2001 




INTRA-TRANSMISSION 
REQUIREMENT SIGNAL 



JAN 0 9 2DM 



V 



[FIG. 4] 



CO 

o 



LO 
O 



o 



1 



CO 

o 



1 



< 

O 
O 
—I 
CQ 

Q 
LU 
Q 
O 
O 



111 

IT £ ll. 
u_ o CO 
uu z 
O < 
o pc 



2P 

£1 



go 
o 



LU 
Q 

< 

LU 



<o 



o 
o 

_l 
m 

Q 
LU 
Q 

o 
o 

CNJ 

o 



CO 

o 

Q_ 




1 



[NAME OF DOCUMENT] SPECIFICATION 

[TITLE OF THE INVENTION] CODING APPARATUS AND CODING 
METHOD OF TIME-VARYING IMAGE SIGNAL 
[WHAT IS CLAIMED IS:] 
5 [Claim 1] A coding apparatus of a time-varying image signal, said apparatus 

comprising: intra-coding means for performing intra-coding in which coded 
block formed by division of a time-varying image signal to a plurality of blocks 
are coded as they are; and coding controlling means for performing control of 
coding so that successive intra-coding of N pictures are performed from a 

10 beginning of communication. 

[Claim 2] The coding apparatus of a time-varying image signal according to 
claim 1, wherein said coding controlling means makes picture qualities of (N - 1) 
pictures from the beginning of communication relatively rough and makes a 
picture quality of a Nth picture from the beginning of the communication 

15 relatively fine. 

[Claim 3] A base station apparatus comprising a coding apparatus of a time- 
varying image signal according to claim 1 or 2. 

[Claim 4] A communication terminal apparatus comprising a coding 
apparatus of a time-varying image signal according to claim 1 or 2. 

20 [Claim 5] A decoding apparatus of a time-varying image signal, said 

apparatus comprising: decoding means for decoding an image-coded data; 
memorizing means for memorizing position information of a coded block in a 
time-varying image signal, the coded block corresponding to an image-coded 
data that could not correctly be decoded owing to a transmission error, in a case 

25 where said image-coded data is an image-coded data after performing of intra- 
coding thereof; and requiring means for ascertaining whether a coded block that 
could not correctly be decoded even once exists in said memorizing means or not 
when a first image-coded data after performing of motion compensation 
prediction coding thereof from a beginning of communication is received, and 
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for requiring transmission of a picture after performing of intra-coding thereof 
when existence of the coded block, which has not been decoded correctly, is 
ascertained. 

[Claim 6] The decoding apparatus of a time- varying image signal according 
5 to claim 5, wherein said decoding means does not perform decoding of the 
image-coded data after performing of the motion compensation prediction 
coding thereof in a case where the coded block that could not correctly be coded 
even once exists in said memorizing means when the first image-coded data after 
performing of the motion compensation prediction coding from the beginning of 

10 the communication is received. 

[Claim 7] A base station apparatus comprising a coding apparatus of a time- 
varying image signal according to claim 5 or 6. 

[Claim 8] A communication terminal apparatus comprising a coding 
apparatus of a time-varying image signal according to claim 5 or 6. 

15 [Claim 9] A coding method of a time-varying image signal, said coding 

method comprising: an intra-coding step for performing intra-coding in which 
coded blocks formed by division of a time-varying image signal to a plurality of 
blocks are coded as they are; and a coding controlling step for performing control 
of coding so that successive intra-coding of N pictures is performed from a 

20 beginning of communication, and for making picture qualities of (N - 1) pictures 
from the beginning of the communication relatively rough, and further for 
making a quality of a Nth picture from the beginning of the communication 
relatively fine. 

[Claim 10] A decoding method of a time-varying image signal, said method 
25 comprising: a decoding step for decoding an image-coded data; a memorizing 
step for memorizing position information of a coded block in a time-varying 
image signal, the coded block corresponding to an image-coded data that could 
not correctly be decoded owing to a transmission error, in a case where said 
image-coded data is an image-coded data after performing of intra-coding 
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thereof; and a requiring step for ascertaining whether a coded block that could 
not correctly be decoded even once exists or not when a first image-coded data 
after performing of motion compensation prediction coding thereof from a 
beginning of communication is received, and for requiring transmission of a 
5 picture after performing of intra-coding thereof when existence of the coded 
block, which has not been decoded correctly, is ascertained. 

[Claim 11] The decoding method of a time-varying image signal according 
to claim 10, wherein in said decoding step, decoding of the image-coded data 
after performing of the motion compensation prediction coding thereof is not 
10 performed in a case where the coded block that could not correctly be coded 

even once exists when the first image-coded data after performing of the motion 
compensation prediction coding from the beginning of the communication is 
received. 

[DETAILED DESCRIPTION OF THE INVENTION] 
15 [0 0 0 1] 

[TECHNICAL FIELD OF THE INVENTION] 
The present invention relates to a coding apparatus and a coding method of 
digital time- varying image signals for the use of a visual telephone, a video 
conference, and the like, and more particularly to a coding apparatus and a 
20 coding method of digital time-varying image signals in image communication on 
transmission lines on which transmission errors are generated. 
[0 0 0 2] 
[PRIOR ART] 

As a conventional coding method of digital time-varying image signals, there 
25 can be cited the coding method in ITU-T (International Telecommunication 

Union - Telecommunication Standardization Sector) Recommendation H.261 that 
was recommended in March, 1993. The featured coding method of H.261 is a 
motion compensation prediction system. The motion compensation prediction 
system is concretely performed as follows. 
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[0 0 0 3] 

First, an input image picture and a pre-coded picture are compared, and a 
motion quantity between them is measured (motion detection). An input image 
picture is predicted on the basis of the motion quantity and the pre-coded picture. 
5 The difference between the predicted image (prediction image) and the input 
image picture (prediction error signal) is calculated, and the prediction error 
signals and the aforesaid motion quantity are transmitted to a reception side. 
Thereby, image information can be transmitted in a small data quantity. 
[0 0 0 4] 

10 Moreover, in H.261, there is another method different from the motion 

compensation picture prediction system. The method does not use the difference 
between the prediction image and the input image picture, but the method codes 
the input image picture itself. The method is called as "intra-coding mode''. The 
intra-coding mode is used in a case where any pre-coded pictures exist such as 

15 the beginning of communication although the generated data quantity is larger 
than that in the motion compensation prediction system, and in a case where the 
correlation between an input image picture and a pre-coded picture is low and 
the data quantity is larger than that in the motion compensation prediction 
system. 

20 [0 0 0 5] 

Moreover, in the case where an transmission error is generated on the 
transmission lines and a section of images deteriorated, because the deterioration 
of the picture quality is propagated to the next picture in turn in the motion 
compensation prediction system in which only the prediction error signal is 

25 transmitted, the deterioration of the picture quality can be recovered by the 
adoption of the intra-coding. 
[0 0 0 6] 

A picture is divided into blocks (coded blocks), each having 16 x 16 pixels in 
both of the motion compensation prediction system and the intra-coding mode, 
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and both the systems are applied at ever}' coded block. A picture in which all of 
the coded blocks in it are forcedly intra-coded is called as "intra-picture", and a 
picture coded in conformity with the motion compensation prediction system is 
called as "inter-picture". 
5 [0 0 0 7] 

On the other hand, there is a concealing processing technique as a technique 
for suppressing the deterioration of the picture quality when a transmission error 
occurs during transmission. The concealing processing technique is the 
processing to do voluntarily on the side of the reception, and is not included in 

10 the contents which are prescribed by the recommendation. However, by 
performing the processing, the picture quality deterioration in case of the 
occurrence of the transmission error can be suppressed. As one of the concealing 
processing techniques, there is a method in which when a transmission error 
occurred and received coded block data can not be decoded correctly, coded 

15 block data existing at the same position in the pre-coded picture is output as it is. 
[0 0 0 8] 

Moreover, as one of the concealing processing techniques, there is a method 
in which a motion quantity of a coded block that could correctly be decoded and 
exists at a peripheral position is adopted as the motion quality of the present 
20 coded block and a prediction image is generated from a pre-coded picture by the 
use of the adopted motion quantity and the generated prediction image is output. 
[0 0 0 9] 

[PROBLEMS TO BE SOLVED BY THE INVENTION] 
When image communication begins, generally, an intra-picture is used as the 
25 first picture. This is because a pre-coded picture that becomes always necessary 
in case of motion compensation prediction coding does not exist at this time. 
[0 0 10] 

When a transmission error occurs during the transmission of the first picture, 
a coding block of a section of the first picture becomes impossible to be decoded 
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correctly. In this case, because any pre-coded picture does not exist it is 
impossible to do the concealing processing using a section of the pre-coded 
picture. Accordingly, the concealing processing of the section of the first picture 
cannot help performing by means of a beforehand prescribed value. 
5 [0 0 11] 

As described above, the picture quality when a transmission error occurred in 
the first picture deteriorates more remarkably than the picture quality when 
concealing processing is performed in the case where a pre-coded picture exists. 
Moreover, because the motion compensation prediction system is used, there is a 
10 problem that the deterioration of the picture quality in the first picture is 

propagated in the second picture and pictures after it with the elapse of time. 
[0 0 12] 

The present invention is carried out in view of the foregoing, and the object of 
the present invention is to provide a coding apparatus and a coding method of a 
15 time-varying image signal, both capable of suppressing the remarkable picture 
quality deterioration at the time of the beginning of communication. 
[0 0 13] 

[MEANS FOR SOLVING THE PROBLEMS] 
To solve the abovementioned problems, the following steps are taken in the 
20 present invention. 

The present invention has a configuration comprising an intra-coding means 
for performing the intra-coding in which coded blocks formed by the division of 
a time-varying image signal to a plurality of blocks are coded as they are, and a 
coding controlling means for performing the control of coding so that the 
25 successive intra-coding of N pictures are performed from the beginning of 
communication. 

[0 0 14] 

According to the configuration, the probability that a coded block at the same 
position becomes impossible to be correctly decoded even once can be decreased 
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by the successive transmission of an intra-picture (N - 1) times, and the 
propagation of the deterioration of picture quality is obviated. Consequently, 
even if a transmission error is generated in the first picture and a coded block 
that could not correctly be decoded exists, because the next picture is transmitted 
5 after the intra-coding thereof, it becomes possible to recover the coded block 
from being deteriorated in its picture quality unless the coded block at the same 
position in the next picture can correctly be decoded owing to a transmission 
error. 

[0 0 15] 

10 The present invention has a configuration in which the coding controlling 
means makes the picture qualities of (N - 1) pictures from the beginning of 
communication relatively rough and makes the picture quality of the Nth picture 
from the beginning of the communication relatively fine. 
[0 0 16] 

15 According to the configuration, a code quantity can be suppressed to be small, 

and transmission time can be shortened. Thereby, the probability of the 
occurrence of a transmission error in a picture can be decreased. 
[0 0 17] 

Moreover, the present invention provides a base station apparatus comprising 
20 the above coding apparatus of the time- varying signal, and provides a 

communication terminal apparatus comprising the above coding apparatus of 
the time-varying signal. 
[0 0 18] 

The present invention comprises: decoding means for decoding an image- 
25 coded data; memorizing means for memorizing position information of a coded 
block in a time-varying image signal, the coded block corresponding to an 
image-coded data that could not correctly be decoded owing to a transmission 
error, in a case where said image-coded data is an image-coded data after 
performing of intra-coding thereof; and requiring means for ascertaining 
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whether a coded block that could not correctly be decoded even once exists in 
said memorizing means or not when a first image-coded data after performing of 
motion compensation prediction coding thereof from a beginning of 
communication is received, and for requiring transmission of a picture after 
5 performing of intra-coding thereof when existence of the coded block, which has 
not been decoded correctly, is ascertained. 
[0 0 19] 

According to the configuration, an intra-picture which does not have the 
coding block which could not correctly be decoded in conformity with the intra- 
10 coding mode even once can be obtained, and the time-wise propagation of the 
remarkable deterioration of image quality can be obviated. 
[0 0 2 0] 

The present invention has a constitution in which the decoding means does not 
perform decoding of the image-coded data after performing of the motion 
15 compensation prediction coding thereof in a case where the coded block that 

could not correctly be coded even once exists in the memorizing means when the 
first image-coded data after performing of the motion compensation prediction 
coding from the beginning of the communication. 
[0 0 2 1] 

20 According to the configuration, the reference to the coded block which could 

not correctly be decoded even once in conformity with the intra-coding mode by 
an inter-picture is obviated, and thereby the time-wise propagation of the 
remarkable deterioration of a picture quality can be avoided. 
[0 0 2 2] 

25 Moreover, the present invention provides a base station apparatus comprising 
the above decoding apparatus of the time-varying signal, and provides a 
communication terminal apparatus comprising the above decoding apparatus of 
the time- varying signal. 
[0 0 2 3] 
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The present invention comprises: an intra-coding step for performing intra- 
coding in which coded blocks formed by division of a time-varying image signal 
to a plurality of blocks are coded as they are; and a coding controlling step for 
performing control of coding so that successive intra-coding of N pictures is 
5 performed from a beginning of communication, and for making picture qualities 
of (N - 1) pictures from the beginning of the communication relatively rough, 
and further for making a quality of a Nth picture from the beginning of the 
communication relatively fine. 
[0 0 2 4] 

10 According to the method, the probability that a coded block at the same 

position becomes impossible to be correctly decoded even once can be decreased, 
and the propagation of the deterioration of picture quality is prevented, by 
transmitting an intra-picture (N - 1) times successively. Consequently, even if a 
transmission error is generated in the first picture and a coded block that could 

15 not correctly be decoded exists, because the next picture is transmitted after the 
intra-coding thereof, it becomes possible to recover the coded block from being 
deteriorated in its picture quality unless the coded block at the same position in 
the next picture can correctly be decoded owing to a transmission error. 
[0 0 2 5] 

20 The present invention comprises: a decoding step for decoding an image- 
coded data; a memorizing step for memorizing position information of a coded 
block in a time-varying image signal, the coded block corresponding to an 
image-coded data that could not correctly be decoded owing to a transmission 
error, in a case where the image-coded data is an image-coded data after 

25 performing of intra-coding thereof; and a requiring step for ascertaining whether 
a coded block that could not correctly be decoded even once exists or not when a 
first image-coded data after performing of motion compensation prediction 
coding thereof from a beginning of communication is received, and for requiring 
transmission of a picture after performing of intra-coding thereof when existence 
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of the coded block, which has not been decoded correctly, is ascertained. 
[0 0 2 6] 

According to the method, an intra-picture having no coded block that could 
not correctly be decoded even once in conformity with the intra-coding mode can 
5 be obtained, and thereby the time-wise propagation of the remarkable 
deterioration of picture quality can be avoided. 
[0 0 2 7] 

The present invention, wherein in said decoding step, decoding of the image- 
coded data after performing of the motion compensation prediction coding 
10 thereof is not performed in a case where the coded block that could not correctly 
be coded even once exists when the first image-coded data after performing of 
the motion compensation prediction coding from the beginning of the 
communication is received. 
[0 0 2 8] 

15 According to the method, the reference to the coded block which could not 

correctly be decoded even once in conformity with the intra-coding mode by an 
inter-picture is obviated, and thereby the time-wise propagation of the 
remarkable deterioration of picture quality can be avoided. 
[0 0 2 9] 

20 [DESCRIPTION OF THE SPECIAL EMBODIMENTS] 

The essence of the present invention is that a plurality of pictures are 
continuously coded in conformity with the intra-coding mode (N times) from the 
beginning of communication, and that the first (N - 1) pictures are transmitted in 
rough picture qualities and the last Nth picture is transmitted in a fine picture 

25 quality. 

[0 0 3 0] 

With reference now to the attached drawings, embodiments of the present 
invention will be explained in detail below. 
(Embodiment 1) 
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FIG 1 is a block diagram showing the configuration of a radio communication 
apparatus equipped with a coding apparatus according to embodiment 1 of the 
present invention. Here, the "radio communication apparatus" refers to a base 
station apparatus or a communication terminal such as a mobile station, etc in a 
5 digital radio communication system. Moreover, the radio communication 
apparatus may be a portable terminal and may be configured in a form to be 
used in a state of being connected with a computer. 
[0 0 3 1] 

In the radio communication apparatus, an image is taken in by an imaging 
10 section 101 such as a camera on the transmission side, and is output to an A/D 
transformer 102 as an image signal. In the A/D transformer 102, the image signal 
is transformed to a digital sound signal, and is output to a coding section 103. 
The coding section 103 performs the image-coding processing of the digital 
sound signal, and outputs coded information to a modulation/demodulation 
15 section 104. The modulation/ demodulation section 104 digitally modulates the 
coded image signal, and transmits the digitally modulated image signal to a 
radio transmission circuit 105. The radio transmission circuit 105 performs the 
prescribed radio transmission processing of the modulated signal. This signal is 
sent via antenna 106. Incidentally, a processor 107 performs its processing by 
20 using the data stored in a RAM 109 and a ROM 108 appropriately. 
[0 0 3 2] 

On the other hand, on the reception side of the radio communication 
apparatus, the prescribed radio reception processing of a signal received by the 
antenna 106 is performed by a radio reception circuit 110, and the processed 
25 signal is transmitted to the modulation/ demodulation section 104. The 

modulation/demodulation section 104 performs the demodulation processing of 
the received signal, and outputs the demodulated signal to the decoding section 
111. The decoding section 111 performs the decoding processing of the 
demodulated signal to obtain a digital decoded signal, and outputs the digital 
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decoded signal to a D/A transformer 112. The D/A transformer 112 transforms 
the digital decoded signal output from the decoding section 111 to an analog 
decoded signal, and outputs the analog decoded signal to a display section 113 
such as a display. Finally, the display section 113 displays the image. 
[0 0 3 3] 

Here, the coding section 103 and the decoding section 111 is operated by the 
processor 107 such as a digital signal processor (DSP) by the use of memories 
stored in the RAM 109 and the ROM 108. Moreover, the programs for these 
operations are stored in the ROM 108. 
[0 0 3 4] 

FIG 2 is a block diagram showing the configuration of the coding apparatus 
of the present invention which is applied to the coding section in the radio 
communication apparatus shown in FIG 1. 

In FIG 2, a raster/ coded block transformation section 201 transforms obtained 
image data to a raster/ coded block. The position information of the raster/ coded 
block transformed by the raster/ coded block transformation section 201 is 
transmitted to a multiplexing section 216. Moreover, the data of the raster/coded 
block (the present picture) is transmitted to a motion detection section 202. 
[0 0 3 5] 

The motion detection section 202 detects the motion of the image on the basis 
of the difference between a previous picture and the present picture. In this case, 
the previous picture is output from a frame memory 203. memory controlling 
section 204 controls the output of the reproduced image memorized in the frame 
memory 203 on the basis of the motion quantity information from the motion 
detection section 202. Incidentally, the motion quantity information is 
transmitted to a variable length coding section 215, and is transformed to a 
Huffman code there to be transmitted to the multiplexing section 216. 
[0 0 3 6] 

A picture counter 205 counts the number of pictures. The counted value of 
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the picture counter 205 is transmitted to a coding controlling section 206. The 
coding controlling section 206 judges whether the coding method of input time- 
varying image signal is the intra-coding mode or the motion compensation 
prediction system mode, and then the coding controlling section 206 outputs the 
5 judged coding mode to a switch 207. And the coding controlling section 206 
controls a quantization parameter in conformity with the coding mode. This 
quantization parameter is transmitted to a quantization section 210. Incidentally, 
the coding mode information is transmitted to the multiplexing section 216. 
[0 0 3 7] 

10 The coded block data is compared with the previous picture stored in the 

frame memory 203 by a subtracter 208 in case of the motion compensation 
prediction system mode, and the difference is transmitted to a discrete cosine 
transformation section (DCT) 209. Incidentally, in case of the intra-coding mode, 
the coded block data is transmitted to the discrete cosine transformation section 

15 209. 

[0 0 3 8] 

The data that has received the discrete cosine transformation is transmitted to 
quantization section 210, and is quantized on the basis of the quantization 
parameter transmitted from the coding controlling section 206. The quantized 
20 data of the DCT coefficient is transmitted to a variable length coding section 211, 
and is transmitted to an inverse quantization section 212. The variable length 
coding section 211 transforms the quantized data of the DCT coefficient into a 
Huffman code, and transmits the Huffman code to the multiplexing section 216. 
[0 0 3 9] 

25 The quantized data of the DCT coefficient transmitted to the inverse 

quantization section 212 is inversely quantized and becomes a DCT coefficient to 
be transmitted to an inverse discrete cosine transformation section 213. The 
inverse discrete cosine transformation section 213 performs the inverse discrete 
cosine transformation by the use of the DCT coefficient to obtain coded block 



14 



data corresponding to the difference between the previous picture and the 
current picture. 

[0 0 4 0] 

An adder 214 obtains the present picture by adding the coded block data and 
5 the previous picture, that is, by updating the previous picture in its moved parts. 
The obtained present picture is transmitted to the frame memory 203 and is 
stored therein. 

[0 0 4 1] 

The multiplexing section 216 multiplexes the DCT coefficient, the motion 
10 quantity information, the position information of the coded block, and the coded 
mode to obtain multiplexed data. The multiplexed data is transmitted. 
[0 0 4 2] 

Next, the operations of the coding apparatus having the aforesaid 
configuration will be described. 

15 An input image is divided into coded blocks in a size of, for example, 16 * 16 

pixels in the raster/coded block transformation section 201 to be output 
therefrom. Next, the divided coded block data is transmitted to the motion 
detection section 202, and is compared with a previous picture in the frame 
memory 203 therein. Then, the motion quantity of the present coded block (the 

20 difference between the previous picture and the present picture) is obtained. The 
motion quantity information is transmitted to the variable length coding section 
215, and is transformed to a Huffman code therein to be transmitted to the 
multiplexing section 216. 
[0 0 4 3] 

25 A picture counter 205 counts and outputs the number of pictures input from 
the beginning of communication. The information of the image which was 
beforehand selected (the coding image choice information) by a (not shown) 
processing section for selecting an image to be coded is input into the picture 
counter 205. The picture counter 205 increases its counting value at every 




inputting of the image information. Moreover, the picture counter 205 is 
configured so that the picture counter 205 is automatically reset when the power 
source of the apparatus is turned on or at the initial time of image transmission. 
[0 0 4 4] 

5 The switch 207 switches the output of the picture from the frame memory 203 

on the basis of the information of the coding mode of the coding controlling 
section 206. To put it concretely, in case of the intra-coding mode, the switch 207 
is switched to the side of "0". And, in case of the motion compensation 
prediction system, the switch 207 is switched to the frame memory 203 to make 
10 the frame memory 203 output the date of the previous picture to the subtracter 
208. 

[0 0 4 5] 

The subtracter 208 obtains the difference between the previous picture and 
the present coded block data to output the obtained difference value to the 

15 discrete cosine transformation section 209. In the discrete cosine transformation 
section 209, the difference value is changed into a frequency domain, and it 
becomes a DCT coefficient to be transmitted to the quantization section 210. In 
the quantization section 210, the DCT coefficient is quantized to be transmitted to 
the variable length coding section 211 as a quantized data. In the variable length 

20 coding section 211, the quantized data is transformed to a Huffman code. 

Incidentally, in case of the intra-coding mode, the difference value becomes the 
coded block data as it is, and, in case of the motion compensation prediction 
system, the difference value becomes a motion quantity information. 
[0 0 4 6] 

25 The DCT coefficient of the quantized frequency domain is restructured to the 

original difference value in the inverse quantization section 212 and in the 
inverse discrete cosine transformation section 213, and the restructured 
difference value is added to the previous picture from the frame memory 203 
and is written in the frame memory 203 for the use of the coding the next picture. 
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[0 0 4 7] 

The coding block data transformed to the Huffman code, the DCT coefficient, 
the motion quantity information, the coded block position information and the 
coding mode are multiplexed to be one data in the multiplexing section 216 to be 
output For example, in a multiplex data, as shown in FIG 4, the coded block 
position information 402 is arranged between a start code 401 and a header 403, 
and coding mode information 404, motion quantity information 405 and a 
coefficient of the cosine transformation 406 are arranged following the header 
403, followed by coded block data 407. 
[0 0 4 8] 

The coding apparatus of the present invention surely transmits the first image, 
which is used as a reference image, by transmitting the same image at a plurality 
of times at the beginning of communication or the initial time of the transmission 
of an image by the use of the aforesaid picture counter. Thereby, the processing 
of the flowing steps, i.e. the processing of updating the reference image by the 
difference from the reference image, is made to be sure. As a result, it is possible 
to make the deterioration of picture quality degradation on the image reception 
side reduce. 

[0 0 4 9] 

Next, a transmission control by the picture counter will be described. 

The coding controlling section 206 outputs quantization mode information for 
controlling the coding apparatus of the present invention to perform the intra- 
coding to the quantization section 210 when the counted value from the picture 
counter 205 is equal to or less than a predetermined value (N). In this case, 
because the switch 207 is switched to the "0" side in conformity with an 
instruction from the coding controlling section 206, the quantization section 210 
performs the quantization of the DCT coefficient about the intra-picture. 
[0 0 5 0] 

Moreover, when the counted value of the picture counter 205 is larger than N, 
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the coding controlling section 206 outputs the coding mode information for 
controlling the coding apparatus to perform the coding in conformity with the 
motion compensation prediction system to the quantization section 210. In this 
case, because the switch 207 is switched to the frame memory 203 side in 
5 conformity with the instruction from the coding controlling section 206, the 

quantization section 210 performs the quantization of a DCT coefficient about an 
inter-picture. 

[0 0 5 1 ] 

Moreover, the coding controlling section 206 outputs to the quantization 
10 section 210 a signal for controlling the coding apparatus so that the value of 
quantization parameter is large, namely the image is rough, when the counted 
value is equal to or less than (N - 1), and that the value of the quantization 
parameter is small, namely the image is fine, when the counted value is N. 
[0 0 5 2] 

15 For example, in case of N is three, namely in the case where the number of 

times of the plural transmission is three, examples of the coding mode and the 
quantization parameter in each picture are shown in the following. 
[0 0 5 3] 

1st picture: Intra-coding mode, Quantization parameter = 31 
20 2nd picture: Intra-coding mode, Quantization parameter = 31 

3rd picture: Intra-coding mode, Quantization parameter = 8 

4th picture and the following: Motion compensation prediction system 
quantization, Parameter is arbitrary. 
(Smaller quantization parameters indicate finer images.) 
25 [0 0 5 4] 

The picture quality and the number of times of transmission of the image 
which are transmitted at a plurality of times can be determined under the 
consideration of the certainty of the transmission thereof and the data quantity 
thereof. In consideration of these points, it is preferable that the number of times 
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of transmission is three and only the final image is made to be fine. 
[0 0 5 5] 

When the difficulty of the occurrence of errors in the case where the number 
of times of transmission is three is calculated, the result becomes as follows. As 
5 the preconditions, the following conditions are supposed. Transmission error 
rate: le-4 (Error of one bit occurs at every 10,000 bits on an average), Code 
quantity of a fine picture quality: 16,000 bits, Code quantity of a rough picture 
quality: 6,400 bits. 

[0 0 5 6] 

10 When the first and the second pictures are coded roughly and the third picture 
is coded finely, the code quantity of each picture becomes the following. Code 
quantity of the first picture: 6,400 bits, Code quantity of the second picture: 6,400 
bits, Code quantity of the third picture: 16,000 bits. 
[0 0 5 7] 

15 In this case, if the transmission error rate is le-4, the probability of the 

occurrence of a transmission error in the first picture is 6,400 bits x le-4 = 0.64. 
Moreover, if the number of the transmission units (the unit of the transmission in 
the case where a screen is divided into narrow strips) is nine, the probability that 
an error is generated in any one of the nine transmission units is 6,400 bits x le-4 

20 x 1/9 = 0.07 when nine transmission units have the same probability that an 
error is generated in each unit 
[0 0 5 8] 

Similarly, as for the second picture, too, the probability is 6,400 bits x le-4 x 
1/9 = 0.07. As for the third picture, because the code quantity thereof is 16,000 
25 bits, the probability is 16,000 bits x le-4 x 1/9 = 0.18. 
[0 0 5 9] 

The probability that errors are generated in the same transmission unit among 
me nine transmission units at all of three times of transmission is 0. 07><0. 07><0. 
18=0. 008. 
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[0 0 6 0] 

Because, in the conventional coding apparatus, only the first picture is the 
picture in conformity with the intra-coding mode and the second and following 
pictures are pictures in conformity with the motion compensation prediction 
system, the probability that the reference image becomes impossible to be used 
(the probability that a coded block cannot be decoded owing to a transmission 
error) is 0.18. Therefore, the embodiment of the present invention can decrease 
the probability that it becomes impossible to use the reference image by about 
95%. 

[0 0 6 1] 

Incidentally, as for the code quantity, the ratio of the intra-coding mode (la) 
code quantity (fine), the intra-coding mode (lb) code quantity (rough) and the 
motion compensation prediction system (P) code quantity is about 7:3:1, the 
code quantities from the beginning of communication through the fourth 4 
picture are the following in comparison with the prior art I P P P = 7, 1, 1, 1 = 9 
(in the prior art), lb lb la P = 3, 3, 7, 1 = 14 (in the present invention). Then, the 
increased quantity of the present invention is one and a half times. 
[0 0 6 2] 

Under the consideration of the increased code quantity and the probability 
that the first picture becomes impossible to be used like that, the number of times 
of transmission and the picture quality and so on can be determined. Because the 
generated code quantity depends on input images, these number of times of 
transmission and the picture quality are appropriately changed. 
[0 0 6 3] 

In the coding apparatus of the present invention, a plurality of pictures are 
coded in conformity with the intra-coding mode successively (N times) from the 
beginning of communication, and first (NT - 1) pictures are transmitted in rough 
picture qualities, and further the last Nth picture is transmitted in a fine picture 
quality. 
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[0 0 6 4] 

According to the present invention, the probability that a coded block at the 
same position becomes impossible to be correctly decoded even once can be 
decreased, and the propagation of the deterioration of picture quality is 
prevented, by transmitting an intra-picture (N - 1) times successively. 
Consequently, even if a transmission error is generated in the first picture and a 
coded block that could not correctly be decoded exists, because the next picture 
is transmitted after the intra-coding thereof, it becomes possible to recover the 
coded block from being deteriorated in its picture quality unless the coded block 
at the same position in the next picture can correctly be decoded owing to a 
transmission error. 
[0 0 6 5] 

In this case, because the intra-picture has a code quantity larger than that of 
the inter-picture in conformity with the motion compensation prediction coding 
system, the coding apparatus of the embodiment takes a lot of time necessary for 
the transmission from the side of transmission to the side of reception. 
Accordingly the coding apparatus suppresses the code quantity by transmitting 
the first (N-l) pictures in rough picture quality for shortening the transmission 
time. Moreover, it becomes possible to decrease the probability that a 
transmission error is generated in the (N - 1) pictures by making the picture 
qualities of the (N - 1) pictures rough to decrease the code quantity. 
[0 0 6 6] 
(Embodiment 2) 

FIG 3 is a block diagram showing the configuration of a decoding apparatus 
corresponding to the coding apparatus according to the embodiment 1. 

In FIG 3, a received signal is transmitted to a separation section 301 to be 
separated there to a Huffman code of a DCT coefficient, a Huffman code of 
motion quantity information, coded block position information, and coding 
mode information. The separated codes and information are transmitted to 




21 



respective processing sections. To put it concretely, the DCT coefficient is 
transmitted to a variable length decoding section 302; the motion quantity 
information is transmitted to a variable length decoding section 305; the coded 
block position information is transmitted to a frame memory 307 and a decoding 
5 error memory 310; and the coding mode information is transmitted to an intra- 
transmission requirement judging section 309. 
[0 0 6 7] 

The DCT coefficient that was coded by the variable length decoding section 
302 is transmitted to an inverse quantization section 303 to be quantized 
10 inversely. The DCT coefficient which was quantized inversely is transmitted to 
an inverse discrete cosine transformation section 304, and is used for the inverse 
discrete cosine transformation there. 
[0 0 6 8] 

The motion quantity information that was decoded by the variable length 
15 decoding section 305 is transmitted to a memory controlling section 306. The 
memory controlling section 306 controls a picture output from the frame 
memory 307. Incidentally, when a decoding error is generated in the variable 
length decoding sections 302, 305, a decoding error signal is transmitted to the 
decoding error memory 310. 
20 [0 0 6 9] 

The intra-transmission requirement judging section 309 judges whether an 
intra-transmission requirement is necessary or not on the basis of whether the 
picture in which a decoding error was generated is an intra-picture or not, 
namely whether a coded block that was not correctly decoded even once in 
25 conformity with the intra-coding mode exists or not, and transmits an intra- 
transmission requirement signal to a communication companion. 
[0 0 7 0] 

In the decoding apparatus, the position of a coded block that could not 
correctly decoded owing to a transmission error among intra-pictures received 



22 



from the beginning of communication is memorized in the memory. In the case 
where a coded block that could not correctly decoded in conformity with the 
intra-coding mode when an inter-picture is first received from the beginning of 
the communication, the decoding apparatus is controlled to output an intra- 
picture transmission requirement to the transmission side. To put it concretely, 
the decoding apparatus judges whether a coded block that could not be decoded 
correctly exists or not by reference to the memory at the time of detecting an 
inter-picture first, and judges whether the decoding apparatus outputs an intra- 
picture transmission requirement to the transmission side. 
[0 0 7 1] 

This is due to the following reason. That is, in the case where the coded block 
that could not correctly decoded in conformity with the intra-coding mode even 
once at the time of the reception of an inter-picture, no image data is written in 
the coding block. Consequently, the picture quality of the coded block is 
remarkably deteriorated. When the inter-picture is received in spite of the 
existence of such a coded block, the deterioration of the picture quality is 
propagated and unseemly images are kept on being output. 
[0 0 7 2] 

Accordingly, the position of a coded block that could not correctly decoded 
from the beginning of communication in conformity with the intra-coding mode 
even once is stored. And if the coded block that could not correctly be decoded in 
conformity with the inter-coding mode even once exists when the first inter- 
picture is received after the beginning of the communication, the decoding 
apparatus does not decode the inter-picture, and requires an intra-picture to the 
transmission side. Thereby, an intra-picture having no coded block that could not 
correctly be decoded in conformity with the intra-coding mode can be obtained, 
and then the reference to the coded block that could not be decoded in 
conformity with the intra-coding mode even once by the inter-picture is obviated. 
Thereby, the time-wise propagation of the remarkable deterioration of picture 




quality can be avoided. 
[0 0 7 3] 

Next, the operations of the decoding apparatus having the aforesaid 
configuration will be described. 
5 First the data transmitted from the transmission side is separated to a 

Huffman code of a DCT coefficient a Huffman code of motion quantity 
information, coded block position information and a coding mode information 
by the separation section 301. 
[0 0 7 4] 

10 The Huffman code of the DCT coefficient is decoded to a DCT coefficient 

after quantization by the variable length decoding section 302, and is inversely 
quantized to the DCT coefficient by the inverse quantization section 303. The 
DCT coefficient which was inversely quantized is transmitted to the inverse 
discrete cosine transformation section 304, and is used for the inverse discrete 

15 cosine transformation there, and then an image data is obtained. 
[0 0 7 5] 

The Huffman code of the motion quantity information, too, is similarly 
decoded to the motion quantity information by the variable length decoding 
section 305, and is transmitted to the memory controlling section 306. The 
20 memory controlling section 306 calculates an address for reading image data 
from the frame memory 307 on the basis of the motion quantity information. 
[0 0 7 6] 

An output of the frame memory 307 and image data after the inverse discrete 
cosine transformation are added to each other by the adder 308, and a 
25 reproduced image is reproduced. The reproduced image is output and 

memorized in the frame memory 307 to be used for the decoding of the next 
picture. 

[0 0 7 7] 

The variable length decoding sections 302, 305 severally output a decoding 
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error signal when they detect a code that does not exist as a variable length code 
owing to a transmission error during decoding. The decoding error memory 310 
memorizes the coded block that could not correctly be decoded at every coded 
block. 

[0 0 7 8] 

The decoding error memory 310 is initialized at a value which is not zero and 
one, and the value zero is written in the memory 310 to a coded block that was 
correctly decoded, and the value of one is written in the memory 310 to a coded 
block in which a decoding error occurred. To a coded block that was once 
written as zero, the decoding error memory 310 is controlled so as not to write 
one in it even if a decoding error is generated in the coded block. That is, when a 
decoding error is generated, the error state of the coded block is read out from 
the decoding error memory 310. If the error state is zero, the contents of the 
decoding error memory 310 are not updated. If the error state is the initial value, 
value one is written in, and if the error state is one, the error state is left as it is. 
[0 0 7 9] 

By such controlling, it becomes possible that a coded block that could 
correctly be decoded even once in conformity with the intra-coding mode is not 
memorized in the decoding error memory 310 even if the coded block cannot 
correctly be decoded after that. 
[0 0 8 0] 

The intra-transmission requirement judging section 309 receives the 
separated coding mode information, and refers to the decoding error memory 
310 when the section 309 receives a first inter-picture after the beginning of 
reception. When a coded block that could not correctly decoded even once exist 
in the decoding error memory 310 even if the coding mode is the intra-coding 
mode, the section 309 outputs an intra-transmission requirement signal to the 
transmission side (the side of the communication companion). 
[0 0 8 1] 
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Incidentally, if a concealing processing function is provided on the decoding 
side, because a pre-coded picture for performing the concealing processing 
already exists and the probability that a coded block at the same position cannot 
correctly decoded for (N - 1) times successively is very low even if a transmission 
5 error is generated at the time of receiving the Nth picture, the avoidance of the 
remarkable deterioration of picture quality becomes possible. 
[0 0 8 2] 

By the execution of such control, an intra-picture that has no coded block that 
could not correctly decoded in conformity with the intra-coding mode even once 
10 can be obtained, the reference to the coded block that could not correctly be 

decoded in conformity with the intra-coding mode even once by the inter-picture 
is obviated, and thereby the time-wise propagation of the remarkable 
deterioration of picture quality can be avoided. 
[0 0 8 3] 

15 The interactive image communication becomes possible by the configuration 

providing the aforesaid coding apparatus and the decoding apparatus of the 
present invention and by the use of the configuration on both of the transmission 
side and the reception side. 
[0 0 8 4] 

20 Incidentally, although the time- varying image coding/ decoding according to 

the aforesaid embodiments 1, 2 are described as the time-varying image coding 
apparatus/ the time- varying image decoding apparatus, these time- varying 
image coding/ decoding may be configured as software. For example, the coding 
apparatus and the decoding apparatus may be configured so that time-varying 

25 image coding/ decoding programs are stored in a ROM and the time-varying 
image coding/ decoding are executed in conformity with the program by 
instructions of CPU. Moreover, the software may be read out from a medium 
storing the software, and the time-varying image coding/decoding may be 
executed by a computer. In such a case, too, the same operations and effects as 
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those in the embodiments 1, 2 are developed. 
[0 0 8 5] 

Although a case using radio transmission lines that is easy to generate an 
error during transmission is described, the present invention may also be applied 
5 to a case using wire transmission lines. The present invention especially develops 
its effects in radio image communication terminals. 
[0 0 8 6] 
[EFFECT OF THE INVENTION] 
As described above, according to the present invention, the probability that a 
10 coded block at the same position becomes impossible to be correctly decoded in 
conformity with the intra-coding mode even once can be suppressed to be low, 
and the time-wise propagation of the remarkable deterioration of picture quality 
is obviated. Consequently, it becomes possible to provide an image easy to see 
even if image transmission using transmission lines on which transmission errors 
15 are generated is performed. 
[0 0 8 7] 

Moreover, in the case where there are coded blocks at the same position that 
could not correctly be decoded in conformity with the intra-coding mode even 
once, the present invention does not perform the decoding of an inter-picture. 
20 Consequently, the remarkable deterioration of picture quality is avoided and the 
time-wise propagation of the deterioration is obviated. Thereby an image easy to 
see can be provided. 
[BRIEF DESCRIPTION OF DRAWINGS] 
[FIG 1] 

25 A block diagram showing the configuration of a radio communication 

apparatus equipped with a coding apparatus according to an embodiment of the 
present invention; 
[FIG 2] 

A block diagram showing the configuration of the coding apparatus according 
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to the embodiment of the present invention; 
[FIG 3] 

A block diagram showing the configuration of a decoding apparatus 
corresponding to the coding apparatus according to the embodiment of the 
5 present invention; 
[FIG 4] 

A frame configuration diagram of a signal to be used in the radio 
communication apparatus equipped with the coding apparatus of the present 
invention. 

1 0 » [EXPLANATIONS OF LETTERS OR NUMERALS] 

201 Raster / Coded Block Transformation Information 

202 Motion Detection Section 

203, 307 Frame Memory 

204, 306 Memory Controlling Section 
15 205 Picture Counter 

206 Coding Control section 

207 Switch 

208 Subtracter 

209 Discrete Cosine Transformation Section 
20 210 Quantization Section 

211 Variable Length Coding Section 

212 Inverse Quantization Section 

213 Inverse Discrete Cosine Transformation Section 
214, 308 Adder 

25 215 Variable Length Coding Section 
216 Multiplexing Section 

301 Separation Section 

302 Variable Length Decoding Section 

303 Inverse Quantization Section 
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304 Inverse Discrete Cosine Transformation Section 

305 Variable Length Decoding Section 

309 Intra-transmission Requirement Judging Section 

310 Decoding Error Memory 
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[NAME OF DOCUMENT] ABSTRACT 
[ABSTRACT] 

[OBJECT] To suppress the remarkable picture quality deterioration at the 
time of the beginning of communication. 

[OVERCOMING MEANS] A picture counter 205 counts and outputs the 
number of pictures input from the beginning of communication. A coding 
controlling section 206 outputs coding mode information for controlling a coding 
apparatus to perform intra-coding when a counted value of the picture counter 
205 is equal to or less than a predetermined value (N), and outputs coding mode 
information for motion compensation prediction system when the counted value 
is more than N. Moreover, when the counted value is equal to and less than (N-l), 
the coding controlling section 206 outputs a signal for controlling a quantization 
section 210 to make the value of a quantization parameter large to the 
quantization section 210, and when the counted value is N, the coding 
controlling section 206 outputs a signal for controlling the quantization section 
210 to make the quantization parameter small to the quantization section 210. A 
switch 207 is switched to "0" in case of the intra-coding and is switched to a 
frame memory 203 in case of the compensation prediction system in conformity 
with a signal of the coding controlling section 206. 
[SELECTED DRAWINGS] FIG 2 



